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A  system  is  subject  to  shocks. ,  Each  shock  weakens  the  system  and 
makes  it  more  expensive  to  rmu  It  is  desireable  to  determine  a  replace¬ 
ment  time  for  the  system.  Boland  and  Proschan  (4  }  consider  periodic 
replacement  of  the  system  and  give  sufficient  conditions  for  the  existence 
of  an  optimal  finite  period,  assuming  that  the  shock  process  is  a  non- 
homogeneous  Poisson  process  and  the  cost  structure  does  not  depend  on 
time.  Block,  Borges  and  Savits  (3)  establish  similar  results  assuming  that 
cost  structure  is  time  dependent,  still  requiring  that  the  shock  process 

(p 

is  I  nonhomogeneous  Poisson  process.  We  show, via  a  sample  path  argument^ 
that  the  results  of  (  3^  and  (  4}  hold  for  any  counting  process 
whose  jump  size  is  of  one  unit  magnitude.  - 


□  □ 


1 


1.  INTRODUCTION  AND  SUMMARY.  A  system  is  subject  to  shocks  which 
cause  the  system  to  deteriorate.  In ^references  [  1]  -  [“27^  life 
distribution  properties  of  such  systems  are  discussed  for  different  types 
of  deterioration  processes.  At  best  these  processes  are  right  continuous 
Markov  processes.  Our  interest  in  this  paper  is  to  tackle  a  related  but 

different  problem:  we  assume  that  the  normal  cost  of  running  the  system 

\  / 

is  a  per  unit  of  time  and  that  each  shock  to  the  system  increases  the 
\  / 

running  cost  by  c  per  unit  of  time.  The  cost  of  completely  replacing 

it  s  w  c 

the  system  is ^  The  system  is  to  be  completely  replaced  at  times 

T,  2T,  ....  .  Such  replacement  policies  are  known  as  periodic  replacement 
policies.^  The  value  T  is  known  as  the  period  of  the  policy.  In 
practice,  reliability  analysts  are  often  asked  to  find  the  optimal  value 
of  the  period,  that  is  to  say  the  value  of  T  that  minimizes  some 
functional  of  the  cost.  Such  functionals  are  normally  taken  to  be  the 
long-run  average  cost  per  unit  of  time  or  the  discounted  total  cost. 

Boland  and  Proschan  [4  ]  treat  the  case  where  the  shock  process  is  a 
non-homogeneous  Poisson  process.  Their  proofs  depend  heavily  on  the  fact 
that  a  non-homogeneous  Poisson  process  can  be  transformed  to  a  homogeneous 
Poisson  process  via  a  non-random  time  transformation  and  on  the  probabil¬ 
istic  properties  of  the  Poisson  process.  Block,  Borges  and  Savits  [3  ] 
establish  similar  results  when  the  cost  structure  is  time  dependent.  They 
also  assume  that  the  shock  process  is  a  nonhomogeneous  Poisson  process. 

He  show  via  a  sample  path  argument  that  the  results  of  Boland  and  Proschan, 
Block,  Borges  and  Savits  hold  for  any  counting  process  whose  jump  size 
is  a  unit  magnitude. 

2.  OPTIMAL  PERIODIC  REPLACEMENT  FOR  A  SYSTEM  SUBJECT  TO  REPEATED 
SHOCKS  WITH  TIME  INDEPENDENT  COST. 


For  t  >0  let 

N(t)  ■  Number  of  shocks  that  the  system  is  subject  to  during  the 


1 


Interval  [0,  t]  and  let  N  -  (N(t),t  >  0).  Throughout  we  assume  that 
the  jumps  of  N  are  of  one  unit  magnitude.  Let  (r^)  be  the  sequence  of  the 
jump  times  of  the  process  N. 

Observe  that  the  total  cost  of  running  the  system  per  period  for  a 
given  realization  of  the  sequence  (tn)  is  equal  to 

aT  +  c(t2  ~  Tl^  +  •  •  •  +  c(N(T)  -1)  (tjj(T)”tN(T)-1^ 

+  cs<1>  (I  -  W  +  Co 

which  can  be  written  in  the  form 

aT  +  c  /T  N(t)  dt  +  c  . 

0  ° 

From  Fubini's  theorem  it  follows  that  the  expected  total  cost 

of  running  the  system  per  period  is  given  by 

(2.1)  aT  +  c  /T  M(t)  dt  +  c 
0  ° 

where  M(t)  **  expected  number  of  shocks  in  [0,  t]  amd  M  is  assumed 

to  be  a  continuous  function  on  [0»  °°) . 

From  standard  renewal  theory  argument  it  follows  that  the  long-run 

average  cost  per  unit  of  time  is  given  by 

A(T)  *  [aT  +  c  /T  M(t)  dt  +  c  ]  /T. 

0  0 

2.2  REMARK.  Boland  and  Proschan  [A]  in  their  lemma  1.1  and  Theorem 

1.2  exploit  the  probabilistic  behavior  of  the  non-homogeneous  Poisson 
process  to  prove  (2.1)  when  the  shock  process  N  is  a  non-homogeneous 
Poisson  process. 

Observe  that  A(T)  is  a  differentiable  function  of  T  and  that 
the  first  order  derivative  of  A  at  T  is  given  by 

-  [c  /T  (M(T)  -  M(t))  dt  -  cl  /T2. 

A  O 


A'  (T) 


Moreover 


/T  (M(T)  -  M(t))  dt 

0 

is  positive  and  increasing , 

lim  A' (T)  *  -®,  and  lim  A(T)  *  lim  M(T) . 

T-v  0  T-*-  00  T-*-  °° 

We  seek  to  find  the  value  of  the  periodic  replacement  time  that  minlmezes 
the  lon-run  average  cost  of  running  the  system  per  unit  of  time  and  we  refer 
to  such  a  value  by  the  optimal  periodic  replacement  time.  The  proof  of  the 
following  theorem  follows  from  the  above  observations. 

2.3  THEOREM.  The  optimal  value  of  the  periodic  replacement  time  always 
exists  and  is  equal  to  the  unique  solution  of  the  integral  equation 

/T  [M(t)  -  M(t)  ]  dt  ■  co/c. 

0 

Moreover  it  is  finite  if  and  only  if 

lim  /T  [M(t)  -  M(t) ]  dt  >  co/c. 

T-*-  »  0 

2.4  EXAMPLE.  (Nonstationary  Pure  Birth  Shock  Models)  Assume  that  shocks 
occur  according  to  a  nonstationary  pure  birth  process  as  follows:  Shocks 
occur  according  to  a  Markov  process;  given  that  k  shocks  occured  in 

[0,  t],  the  probability  of  a  shock  occurring  in  (t,  t  +  A)  is  equal  to 
X^(t)  -  o(A),  while  the  probability  of  more  than  one  shock  occurring 

in  [t,  t  +  A)  -  o(A).  Observe  that  in  this  case  the  shock  process  H 
is  a  nonstationary  Markov  process.  However,  the  pair  N*  (t)  *  (N(t),  t) 
form  a  stationary  Markov  process.  Throughout  we  will  assume  without  loss 
of  generality  that  N(0)  s  1.  For  any  point  (k,  t)  in  the  state 


space  E  -  {1,  2,  ...}  x  R+  the  symbol  E  stands  for  the  expectation 

when  the  process  at  time  t  Is  in  state  k.  For  any  bounded  function 
defined  on  E  the  infinitesimal  generator  is  defined  by 

Af(k,t)  *  lim  {[Ek,t  f(N  ,s)  -  f (k,t) ]/(s-t) } 
s+t  8 

It  is  well  know  that 

E1*0  f (N  »t)  -  f(l,0)  =  /£  E1,0  f (N  ,s)  ds. 

t  08 

If  f  is  such  that  for  any  (k,  t)  in  E,  f(k,  t)  ■  f(k)  for  some 
f  defined  on  {1,  2,  ...},  then  it  is  easy  to  see  that 

Af  (k,t)  -  ^  (t)  [f(k  +  1)  -  f  (k)  ] . 

In  particular  if  f(k,  t)  »  k  for  each  k  in  {1,  2,  then 


Af(k,  t)  -  Xfc(t) 


and  therefore 


E1’0  N(t)  -  1  «  /*  E1,0(XN(s)(s))ds 


M(t)  -  1  -  /£  E1,0(XN(8)(s))ds. 


Thus 


/T  [M(t)  -  M(t)]  dt  -  /T  /T  E1’0  (X„,  M*(s)>  dsdt 

0  0  t 


-  /T  s  E1'0  (XMr  .(a))  ds 


_2 

If  "  0(s  )  as  s  **»  then  from  Theorem  2.3  it 

follows  that  the  optimal  value  of  the  periodic  replacement  time  exists 
and  is  finite. 

In  particular  if  for  k  ■  1,  2,  ... 

Xk(t)  -  k  X  (t) 

then  we  have  that 

M(t)  -1  -  St  X(s)  M(s)  ds. 

0 

The  above  equation  has  the  solution 

fl  X(s)  ds 

M  (t)  -  e 

and 

E(AN(t)  ®XP  (/0  d8) 

_2 

which  is  clearly  of  order  s  as  S-+-  »  assuming  that  X  is  an 
increasing  function  in  s.  In  this  case  the  optimal  value  of  the 
periodic  replacement  policy  exists  and  is  finite.  If  X(s)  S  I,  then 
the  optimal  value  of  the  periodic  replacement  time  is  the  unique  finite 
solution  of  the  integral  equation 
eT(T-I)  ■  (cQ  -  c)  /c 

Moreoever  if  X(t)  “  t  then  the  optimal  value  of  the  periodic  replace- 

2  h 

ment  policy  exists  and  is  equal  to  [In  ((cq  +  c)/c)  ] 

2.5  REMARK.  The  non-homogeneous  Poisson  process  case  discussed  in  [4] 
is  a  special  case  of  the  model  discussed  in  Example  2.4  with 


6 


A^  (t)  5  X (t)  for  each  k  -  1,  2,  ...  for  some  X  defined  on  R+. 


2.6  EXAMPLE.  Assume  that  the  shock  process  is  a  renewal  process  with  a 

renewal  function  M(t).  Suppose  that  the  common  distribution  function 

of  the  interarrival  times  is  absolutely  continuous  with  respect  to  the 

Lebesque  measure  and  has  a  derivative  function  *(t)  *  d_  M(t).  It 

dt 

_2 

follows  that  if  m(t)  ■  0(t  )  as  t  »  then  the  optimal  value  of 

the  periodic  replacement  policy  exists  and  is  finite.  For  example  if  the 
interarrival  times  have  finite  mean,  then  m(t)  =  0(1)  as  t  ■+•  » 

and  hence  the  optimal  periodic  replacement  policy  exists  and  is  finite. 


3.  OPTIMAL  PERIODIC  REPLACEMENT  FOR  A  SYSTEM  SUBJECT  TO  REPEATED 
SHOCKS  WITH  TIME  DEPENDENT  COST  STRUCTURE.  In  this  section  we 


discuss  a  model  similar  to  the  one  discussed  in  §2  but  with  general  costs 
that  depend  on  the  number  of  shocks  and  the  time  at  which  shocks  occur. 

For  t  >  0  let  N(t)  ■  Number  of  shocks  the  system  is  subject  to  during 


[0,  t].  The  shock  process  N 


(N(t) ,  t  >  0)  is  assumed  to  have 


jumps  of  size  one  almost  everywhere;  let  (Tn>  be  the  sequence 
describing  the  jump  times  of  the  shock  process  N.  The  cost  of  operating 
the  system  per  unit  of  time  in  +  j^)  is  c^u),  i  «  0,  1,  .... 

and  u  in  R+,  Tq  =  0.  The  normal  cost  of  running  the  system  is  a  per 
unit  of  time  and  the  cost  of  completely  replacing  the  system  is  cQ.  The 
system  is  to  be  completely  replaced  at  times  T,  2T,  ...  and  the  shock 
process  resets  at  zero  at  each  of  these  replacemnts.  By  the  same  argument 
discussed  in  §2  the  expected  total  cost  of  running  the  system  per 
period  is  given  by 


aT  +  /  E 


Vt) 


(t)  dt  +  c 


and  the  long  run  average  cost  of  running  the  system  per  a  unit  of  time 
Is  equal  to  [aT  +  /T  E  c^^  (*)  dt  +  cq  ]/T.  Define  h(t)  -  E(CN(t)^C^ 


The  following  theorem  Is  the  analogue  of  Theroem  2.3  for  this  type  of 
problem. 


3.1  THEOREM.  If  h  Is  continuous.  Increasing,  then  the  optimal  value 
of  the  periodic  replacemnt  time  exists  and  Is  the  unique  solution  of  the 
Integral  equation 

/T  [h(T)  -  h(t)]  -  co/c 
0 

Moreover  it  is  finite  if  and  only  if 

11m  /T  [h(T)  -  h(t) ]  dt  >  co/c. 

T-*  «  0 

Above  we  only  considered  the  problem  of  determining  the  optimal 

periodic  replacement  time  over  an  infinite  time  horizon.  Now  we 

consider  the  finite  horizon  problem.  We  would  like  to  find  a  replacement 

time  T  that  minimizes  the  total  expected  cost  over  the  interval 

[0,  t).  We  assume  the  same  cost  structure  discussed  above.  Let 

H(u)  *  /u  h(8)  ds.  For  a  period  T  the  total  expected  cost  in  [0,  t) 

0 

is  equal  to 


Kt(T) 


'at  +  m  [H(T)  +  cqJ  +  H(s  -  mT)  if  mT  <  t  <  (m+l)T, 
at  +  m  H(T)  +  (m  -  1)  cq  if  mT  -  t. 


3.2  THEOREM.  If  H(u)  is  a  continuous  function  on  [0,  t],  then 
Kt(.)  is  continuous  on  [0,  t]  except  possibly  at  the  points 


t,  t/2,  t / 3 ,  ... 


and  is  right  continuous  at  these  points. 


3.3  THEOREM.  Assume  that  h(u)  is  a  continuous  increasing  function 
on  [0,  t].  Then  Kt(T)  is  minimized  on  [0,  t]  at  one  of  the  points 
t,  t/2,  t/3,  ...  . 

3.4  REMARK.  Theorems  3.2  and  3.3  are  established  in  [3]  when  the 
shock  process  is  a  non-homogeneous  Poisson  process. 
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